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(54) Method and system for creating and sending a facsimile using a digital pen 
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(57) The present application describes systems and 
methods for composing and sending facsimile messag- 
es using a digital pointing instrument. In further config- 
urations, a user utilizes a pen to indicate a reference to 
a document that is appended to the outgoing facsimile. 
In another further configuration, the user utilizes a form 
having pre-defined regions that are used to correlate a 
pen stroke with a desired action. 
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Description 

[0001] The illustrative embodiments disclosed in the 
present application are useful in systems including 
those for processing facsimile messages and more par- 
ticularly are useful in systems including those for send- 
ing facsimile messages using a digital pen. 
[0002] Traditional facsimile machines are typically 
found in small to large corporate offices and are often 
found in the small office/home office (SOHO) settings. 
Facsimile machines may be found in small retail busi- 
nesses, hotels, schools and in stores providing such 
services to individuals as a retail service. Such typical 
facsimile machines include a chassis having a connec- 
tion to an analog telephone line, an analog modem for 
communication and a keypad for dialing the telephone 
number of a receiving facsimile machine. Such typical 
facsimile machines include a monochromatic (black and 
white), one bit per pixel scanner forfacsimile output and 
a printerfor output. The printertechnology utilized in tra- 
ditional facsimile machines include thermal printing, 
inkjet printing and laser printing. The scanner input and 
printing engine are typically limited to 8.5-inch wide pa- 
per. Accordingly, the size of documents that may be sent 
using a traditional facsimile machine is limited. The tra- 
ditional facsimile machine is limited in the size of docu- 
ments that may be printed, although incoming docu- 
ments may in some cases be scaled to fit the available 
paper size. 

[0003] The traditional facsimile machine receives 
documents that may be typed or handwritten. The doc- 
uments are scanned into a facsimile transmission for- 
mat that is typically compressed. The sender inputs the 
recipient telephone number, the facsimile machines ne- 
gotiate a connection and protocol and the facsimile is 
transmitted as a compressed monochromatic bitmap 
representation of the original. 

[0004] More recently, facsimile service systems have 
become available for general-purpose computers such 
as the Windows/Intel personal computer platforms in 
which a user may send a computer file such as a word 
processing file to a recipient facsimile machine. In such 
a system, the file is typically converted to a facsimile 
format file such as TIFF and the computer uses its an- 
alog modem to send the facsimile as if it had been 
scanned into a facsimile machine. These systems are 
useful only when the document to be sent is available 
in some digital form and are not useful for sending hand- 
written information such as a signed letter. Certain other 
systems utilize a general-purpose scanner and general- 
purpose computer to provide the functionality of a tradi- 
tional facsimile machine. 

[0005] In using a traditional facsimile machine, a user 
may handwrite a cover sheet having the number of pag- 
es and the origin and destination information written on 
it. The user will then send the facsimile cover sheet with 
the attached letter to the intended recipient by dialing 
the recipient facsimile machine number and starting the 



transmission. 

[0006] Accordingly, a user must have access to the 
attached letter at the traditional facsimile machine or on 
the general-purpose computer of the facsimile service 

5 system. Such a user may be required to walk to the neat- 
est facsimile machine and may also be required to wait 
in line for an available facsimile machine or scanner for 
a facsimile service system. Similarly, the user of a fac- 
simile service system must have access to the general- 

10 purpose computer to process a facsimile and may also 
have to wait for an available scanner 
[0007] A reference entitled method and apparatus for 
pen-based faxing is shown in United States Patent 
Number 6,201,903 issued March 13, 2001 to Wolff, et 

15 al. and is incorporated herein by reference. The refer- 
ence describes a system for designating a recipient of 
a facsimile using strokes made with a pen. 
[0008] The present application describes illustrative 
embodiments of systems and methods for composing 

20 and sending facsimile messages using a digital pointing 
instrument. In further illustrative embodiments, a user 
utilizes a pen to write a reference to a document that is 
appended to the outgoing facsimile. In a further illustra- 
tive embodiment, the user utilizes a form having pre-de- 

25 fined regions that are used to correlate a pen stroke with 
a desired action. In another further illustrative embodi- 
ment, a back-end facsimile processor updates the fac- 
simile cover sheet before sending it using obtained or 
calculated information such as the number of pages at- 

30 tached. 

[0009] FIG . 1 is a schematic representation of a digital 
pen facsimile service system according to an illustrative 
embodiment of the present application. 
[001 0] FIG . 2 is a schematic representation of a digital 

35 pen facsimile service system according to another illus- 
trative embodiment of the present application. 
[0011] FIG. 3 is a schematic representation of a data 
processing system of a digital pen facsimile service sys- 
tem according to an illustrative embodiment of the 

40 present application. 

[0012] FIG. 4 is a flow chart showing a process for 
generating facsimile messages according to another il- 
lustrative embodiment of the present application. 
[0013] FIG. 5 is a top view of a facsimile cover sheet 

45 form according to an illustrative embodiment of the 
present application. 

[0014] A method and system for sending a facsimile 
using a digital pen is described. While facsimile ma- 
chines are commonplace in locations such as offices, 

50 they are relatively large devices that include a fixed 
width scanner. Facsimile machines are typically station- 
ary and connected to a telephone line. Facsimile service 
software programs that typically utilize a personal com- 
puter with a modem connected to a telephone line allow 

55 a user to select a facsimile enabled print driver in order 
to convert a currently displayed document into a facsim- 
ileformat to be sent using thefacsimile capable modem. 
In such a system, the personal computer may be 
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equipped with a scanner used to digitize documents, but 
the scanner typically has the capability to scan docu- 
ments that are not wider than a letter size sheet of paper. 
Facsimile machines also typically have a letter size 
scanner width that limits the width of a document that 
can be transmitted using the facsimile machine. 
[0015] Digital pointing devices such as the pen and 
tablet systems available from Wacom Technology Corp. 
of Vancouver, Washington, USA, allow a user to utilize 
a computer to capture pen strokes that the user traces 
over a tablet. Digital pointing devices may utilize capac- 
itive sensors or other grid based sensors to determine 
absolute or relative position of the pointing device. 
[0016] Digital pens allow a user to capture or digitize 
handwriting or pen strokes that the user writes on a me- 
dium such as apiece of paperby using a processor such 
as a personal computer. Certain digital pens utilize an 
imaging device to scan or record an image of the pen 
stroke. Certain other digital pens use mechanical sen- 
sors in order to record a pen stroke. The pen systems 
may utilize positioning systems such as light-based 
scanning systems including infrared (ir) sources and de- 
tectors in order to determine an absolute or relative po- 
sition of the pen. Digital pen systems include the 
N-Scribe system available from Digital Ink of Wellesley, 
MA and the E-Pen system available from E-Pen InMo- 
tion of Matam, Haifa Israel. A digital pointing device in- 
cludes the V-Pen system available from OTM Technol- 
ogies of Herzliya Israel. 

[0017] Another digital pen system is the Sony-Erics- 
son CHA-30 Chatpen and Anoto paper available from 
Anoto AB of Sweden. The Chatpen utilizes a Bluetooth 
transceiver in order to communicate with a processor 
and the Anoto paper includes a grid encoding informa- 
tion such position information that is detected by the 
Chatpen. Additional information may be captured in- 
cluding information related to pressure, speed and pen 
attitude. The additional information includes biometric 
information that may be used to identify or authenticate 
a user. 

[0018] Commonly owned, co-pending U.S. patent ap- 
plication serial number 09/727,893 and filed November 
30, 2000 describes systems for remote retrieval of mes- 
sages. 

[0019] Commonly owned, U.S co-pending, patent ap- 
plication serial number 09/707,561, filed November 7, 
2000 describes systems for remote retrieval of docu- 
ments. 

[0020] Commonly owned, co-pending U.S. patent ap- 
plication serial number 09/728,237, filed November 30, 
2000 describes systems for remote printing of docu- 
ments. 

[0021] Reference is also made to the following com- 
monly owned co-pending U.S. patent applications: 

application serial number 10/065,282, entitled 
Method And System For Creating a Document Hav- 
ing Metadata, filed September 30, 2002; 



application serial number 10/065,283, entitled 
Method And System For Identifying a Form Version 
filed September 30, 2002; 

application serial number 10/065,284, entitled 
5 Method And System For Remote Form Completion, 

filed September 30, 2002; and 
application serial number 10/065,285, entitled 
Method And System For Identifying a Paper Form 
Using a Digital Pen, filed September 30, 2002. 

10 

[0022] The Digital Pen. 

[0023] The present application describes systems 
and methods for composing messages using a pointing 
device. The illustrative embodiments described herein 
15 utilize a digital pen in order to compose and send a fac- 
simile. However, other sensing devices may be utilized 
to compose other messages. 

[0024] The digital pen is utilized to capture information 
regarding the pen strokes of a user. In the illustrative 

20 embodiments described herein, a Chatpen and Anoto 
paper is described. However, other digital pens may be 
utilized. Certain digital pens utilize position determina- 
tion be determining the actual location of the pen on a 
piece of paper in order to provide a relative location in 

25 terms of the location in the space of the piece of paper. 
Certain digital pens scan the ink as it is applied to digitize 
a stroke while others sense the stroke using sensors 
such as pressure sensors, Doppler sensors, accelerom- 
eters and other sensing mechanisms. 

30 [0025] The Chatpen and Anoto paper provide a pen 
the writes using ink on paper printed with an Anoto pat- 
tern. The Chatpen includes a sensor to detect the Anoto 
pattern. The detected pattern identifies the relative pen 
location on a grid of the pattern using a pattern look-up 

35 processor that may be locally or remotely resident. The 
relative location allows the pen stroke and pattern look- 
up processorto determine where the pen is on a defined 
logical space of the pattern. Certain logically defined 
two-dimensional areas of the pattern may be defined as 

40 representing certain functions. For example, Anoto pa- 
per may be printed with a box that includes a particular 
portion of the pattern that is attributed the meaning of 
"Send Facsimile." The media may be printed with an in- 
dication to the user that such box has been attributed 

45 that meaning or that portion of the pattern may be used 
in a box that is mandatory for a facsimile cover sheet 
such as the "To:" number field. The form may be pre- 
printed with the format of a facsimile cover page. 
[0026] Using the Chatpen, the stroke, biometric and 

50 pattern position information is sent to the pen stroke 
processor via a wireless Bluetooth TM communications 
channel that is secure across a personal area network. 
Accordingly, a facsimile message is composed without 
a facsimile machine or facsimile scanner using a digital 

55 pen that is portable. 

[0027] The illustrative embodiments describe meth- 
ods and apparatus for capturing pen strokes, input data 
such as commands. Additional methods and apparatus 
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for composing and sending the messages are de- 
scribed: The processes and apparatus described may 
be implemented using hardware, software or a combi- 
nation of both. The communications channels may be 
wireless or wired and may utilize security techniques 
such as encryption. The data storage and data proces- 
sors may be locally or remotely located. 

The Message Composition System. 

[0028] Referring to FIG. 1 , a first illustrative embodi- 
ment describing a digital pen facsimile service system 
1 is shown. 

[0029] Digital Pen 10 includes a processor 14, mem- 
ory 12, ink 17, a camera or image sensor 15, a battery 
16 and a wireless transceiver 11. It also includes bio- 
metric sensors (not shown). In an alternative, the ink 1 7 
is machine detectable. In another embodiment, the ink 
is invisible. 

[0030] The pen 1 0 includes a pen tip (not shown) that 
writes using the ink 1 7. Writing sensors (not shown) pro- 
vide data regarding the stroke such as pressure, speed 
and pen attitude. 

[0031] In one embodiment, the digital pen is a Chat- 
pen using a Bluetooth TM transceiver. Bluetooth TM uti- 
lizes several layers of security. At a link level, remote/ 
local device authentication is required before any com- 
munication can take place. At the Channel level, a link 
level connection occurs and then the devices need to 
authenticate before a communications channel is estab- 
lished. Additionally, the data payload being transmitted 
may be encrypted. In this embodiment, appropriate se- 
curity at several protocol layers is utilized including the 
application layer. 

[0032] In an alternative, the pen includes audio input/ 
output including synthesized voice output and voice rec- 
ognition. Visual output is provided using an LCD display 
and LEDs and tactile feedback is provided using servo- 
mechanisms. Physical input includes an input button. 
[0033] The embodiments described herein may utilize 
biometric data for purposes including identification and 
authentication of a user. In this embodiment, the digital 
pen 10 is a Chatpen digital pen available from Anoto, 
AB. The pen 10 provides biometric data relating to the 
pen strokes used including hand speed, pen tip pres- 
sure and the inclination angle between pen and paper. 
Such data is referred to herein as BIODATA. In alterna- 
tive embodiments, the BIODATA may include other bio- 
metric data such as a retinal scan or fingerprint scan 
performed using an external processor such as laptop 
42 that is co-located with the pen or by the pen 1 0. The 
pen 1 0 is assigned a unique identification code that is a 
unique serial number for the pen. In an alternative, the 
PUID is a Bluetooth TM MAC code or other unique or 
group assigned code. 

[0034] The system 1 includes at least one pen 1 0 that 
establishes a personal area network using Bluetooth 
TM. The paired device may be a Bluetooth TM router 46 



that connects to the digital pen 10 using wireless con- 
nection 25 and provides a gateway using communica- 
tions connection 52 to a system LAN 50 orto the Internet 
60 (connection not shown). The paired device may in- 
5 elude a wireless capable PDA 44 that has a Bluetooth 
connection 24 and a connection 54 to the LAN 50. Sim- 
ilarly, the digital pen 1 0 may connect using wireless con- 
nection 23 to laptop 42 that is connected to the LAN 50 
by connection 56 and the Internet 60 using connection 
66. Furthermore, the digital pen 10 may be paired with 
cellular telephone 40 using connection 22. The cellular 
telephone 40 is connected to cellular base station 32 
using connection 27. Additionally, the digital pen may 
send or receive signals using satellite 30 using channel 
21 . The signals may include GPS or other signals. The 
satellite may be connected to a communications net- 
work such as the cellular system using connection 26. 
[0035] Here, the system 1 includes a server 80 that 
includes storage 86 connected by connection 84 to 
processor 82. The server 80 is connected ot the LAN 50 
using communications channel 88. Here, the server 
hosts files that may be used as attachments and authen- 
tication data for users. The server 80 is connected to a 
Private Branch Exchange (PBX) 90 using connection 
92. The PBX 90 is connected to the Public Switched Tel- 
ephone Network 98 (PSTN) using connection 94 that 
may be a T1 line. The PSTN is the telephone network 
used to transmit facsimile messages. The PBX 90 is al- 
so connected to LAN 50 using connection 96 and is ac- 
cessible to the devices such as the gateway 46, PDA 
44 and Laptop 42. The cellular system 32 is also con- 
nected to the PSTN 98 (not shown). 
[0036] Furthermore, server 70 is connected to a net- 
work such as the Internet 60 using connection 78. Serv- 
er 70 includes processor 72 connected to storage 76 
using connection 74. Here, the Anoto pattern lookup 
service may be remotely located and may be accessed 
while determining pen location and other pattern lookup 
related data. 

[0037] The system 1 provides several security options 
including having biometrics data stored for comparison 
in a database on a secure server 80. 
[0038] The Handheld processor44 is a PDA including 
a docking cradle or wireless connection for access to a 
LAN 50. Coarse position information regarding digital 
pen 1 0 location can be determined by locating th paired 
device such as cellulartelephone 40 that can be located 
by triangulation if transmitting. 

[0039] Cellular telephone 40 is connected to cellular 
operator system 32. The cellulartelephone could simply 
provide a data link such as a GSM link. In an alternative, 
the cellulartelephone could include additional process- 
ing capacity and be used to capture and/or manipulate 
data. Corporate LAN 50 is connected to the Internet 60 
using T1 line 64. Alternatively, the connections could be 
over private lines or may be a Virtual Private Network. 
It is contemplated that all of the connections utilize ap- 
propriate security measures. 
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[0040] Other well-known input devices, servers, proc- 
essors, networks and communications mechanisms 
may be used. A back-end application may be utilized to 
process pen strokes. The back end application then rec- 
ognizes command strokes or strokes in command loca- 
tions identified by the pattern. The data written by a user 
in a particular data input f lied can be rasterized and then 
subjected to Optical character recognition (OCR) in or- 
der to identify the data written by the user. 
[0041] Laptop 42 utilizes a mobile Pentium 4 proces- 
sor and Windows XP. The server processors are geo- 
graphically and load balanced application servers using 
systems available from Sun Microsystems and the stor- 
age servers use multiple location redundant backup 
systems. Additionally, other appropriate wireless and 
wired networks and connections may be utilized. It is 
contemplated that other communications channels such 
as OC-3 lines or wireless connections could be used in 
place of the T1 lines. Similarly, the other communica- 
tions channels could be replaced with alternatives. As 
can be appreciated, various communication flows may 
be utilized, some of which will be chattier than others. 
Laptop 42 could also provide gateway access to the 
TCP/IP Internet network. 

[0042] The present embodiment may alternatively 
use any pen or stylus like device that provides for elec- 
tronically recording strokes. Position information may be 
processed into strokes ortransmitted in a separate data 
stream. 

[0043] The digital pen 10 approximates the size of a 
traditional pen and may be used by a user to handwrite 
information. The digital pen may detect pattern informa- 
tion that may be relayed to a pattern lookup server 70 
across the Internet 60. Responsive information may 
then be sent back to the message processor. 
[0044] Here, the co-located processor 44, 42, 40 or 
remote processor 82 may receive pen data including 
stroke data, pattern data and other input data. 
[0045] Transmitter/receiver 1 1 transmits and receives 
signals to and from the paired base unit 40, 42, 44, 46 
that provide a communications linkfor sending pen data 
that is used by the message processor to compose and 
send a message such as a facsimile message. 
[0046] The message processor can be implemented 
in the local co-located processor being used such as 40, 
42, 44 or in a remote processor such as 72 or 82. The 
message processor may include processes such as pen 
stroke input processing, form and command processing 
and message composition and communications 
processing. In an alternative, pen 10 and the message 
processor provide handwriting recognition. The mes- 
sage processor may include handwriting recognition or 
may employ a limited set of symbol recognition for com- 
mand processing. Using the Anoto pattern lookup, the 
system may rely on the pattern to determine commands 
rather than be recognizing strokes. 
[0047] Referring to FIG. 2, a schematic representa- 
tion of a digital pen facsimile service system according 



to a second illustrative embodiment is shown. Digital 
pen 210 includes a processor 214, memory 212, ink 
217, a camera or image sensor 215, a battery 216 and 
a wireless Bluetooth transceiver 21 1 . It also includes bi- 

5 ometric sensors (not shown). The pen 210 includes a 
pen tip (not shown) that writes using the ink 21 7. Writing 
sensors (not shown) provide data regarding the stroke 
such as pressure, speed and pen attitude. Here, the pen 
is connected to server 280 using wireless connection 

10 282. The server is connected to PSTN 290 using com- 
munications link 284. the server includes a file server 
for attachments and authentication files and a processor 
for message processing: 

[0048] Referring to FIG. 3, a schematic representa- 

15 tion of a data processing system of a digital pen facsim- 
ile service system according to a third illustrative em- 
bodiment is shown. Here the digital pen (not shown) in- 
cludes the message processor including pen stroke in- 
put processor 310, form and command processor 320 

20 and communication processor 330. The communication 
processor is used to retrieve attachments and to send 
the composed facsimile after it is composed using the 
retrieved attachments. Accordingly, the entire facsimile 
service is included in the digital pen (not shown) 

25 [0049] Referring to FIGs. 4 and 5, a process for com- 
posing a facsimile message is described. 
[0050] In this illustrative embodiment, the intelligence 
or attributed properties are in the form of a pattern 501 
that is either pre-printed on the media 51 0 or printed by 

30 any laser printer capable of printing it. The pattern 501 
may cover the entire form or only selected portions of it. 
[0051] The pattern 501 is available from Anoto AB and 
is used such thatthe grid uniquely defines 2 dimensional 
portions of an enormous 2-dimensional map. Accord- 

35 ingly, the abstract grid location could be assigned many 
meanings including a map to a relative or absolute po- 
sition on a media such as an address filed and destina- 
tion facsimile field. 

[0052] Facsimile Cover Sheet 51 0 includes an Anoto 
40 pattern 501 and several preprinted fields. Field 512 is 
the recipient name filed and field 514 is the related re- 
cipient company filed name. Field 516 is the recipient 
fax number and filed 518 is for the recipient phone 
number. Filed 520 is a subject field. Field 522 is the 
45 sender id field and field 524 is the date field. Field 526 
is the number of pages field and the message processor 
determines the data for this field. Fields 530, 534 and 
538 are attachment fields for inputting attachment iden- 
tification data. Fields 532, 536 and 540 are the respec- 
50 tive description fields that may be determined by the 
message processor. Field 550 includes the message 
field. Fields 555 and 556 include boxes that indicate 
send and abort. 

[0053] Referring to FIG. 4, a process 400 for compos- 
es jng a facsimile message is described. The process be- 
ings in step 405 and the message processor receives 
and stores pen stroke input data in step 410. Here, the 
pen stroke data may be a data feed in the wireless chan- 
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nel or data sent from a paired device such as a PDA. In 
step 420, the message process 400 determines if the 
form being written on is a facsimile form. If so, the proc- 
ess proceeds to step 430 to parse the input and any 
commands and data. The input process continues until 
a send indication is received at step 440. In 450, the 
message process determines if attachments are re- 
quested. If attachments are not requested, the process 
proceeds to step 480. 

[0054] If attachments are requested, the process pro- 
ceeds to step 460 to authenticate the user using biomet- 
ric information as shown above. The message process 
accesses a database of known biometric data for the 
user and authenticates the user. In step 470, the mes- 
sage process 400 uses the user identification and au- 
thentication in order to identify and locate the attach- 
ment files and obtain the file. The user information may 
make an ambiguous reference to an attachment non- 
ambiguous. The authentication data may be used to en- 
sure that only authorized users have access to the at- 
tachments. For example, in Windows XP, a file may have 
various levels of permissions. Here the pen and user 
identification data may be used to identify the level of 
permission needed and whether the file can be sent to 
the message processor. Here, the message processor 
may utilize the biometric data to obtain password infor- 
mation necessary for the message processor to access 
the requested files. 

[0055] As another example, the user may identify at- 
tachment 0238820. This identifier may be a document 
control serial number obtained from the footer of a doc- 
ument. The user identification may identify the server 
and document management system that the user has 
access to and that information may be used to locate 
the file and to ensure the user has permission to access 
it. In an alternative, the system also determines whether 
the recipient has permission to access the file using a 
lookup table of recipient names or locations. 
[0056] In step 480, the process calculates insert data 
such as the number of pages, date or attachment de- 
scriptions. The insert data is then placed into the form. 
In step 490, the facsimile cover sheet and attachments 
are rasterized and compiled into a facsimile file. In step 
492, the facsimile is sent and any errors are reported. 
The process then ends in step 499. 
[0057] Here, the message processor can use the data 
entered into the recipient name field 512 to determine 
what information to use in recipient company name filed 
if it is not provided. Additionally, the message processor 
may determine the date or the date entered may be ver- 
ified. 

[0058] In an alternative embodiment, a digital pen us- 
ing position sensors similar to those used in a graphics 
drawing tablet is utilized. In this alternative, the media 
is defined as a template based upon position. The tem- 
plate could be stenciled on to the media such as a label 
or envelope in order to aid the user in proper placement 
of the data. The processor that is processing the data 



input into the template could offer a user a template se- 
lection to choose from, each with its own data location 
template definition. In another alternative, the template 
form identifier is placed in machine or human readable 

5 form on the media. The digital pen is then used to read 
the form identifier using a scanning technique or by the 
user tracing over the form number. 
[0059] In another alternative embodiment, other bio- 
metric data may be utilized. For example, the digital pen 

10 1 o may be paired with an external processor such as a 
PDA such that a shared secret is provided to the pen 1 0 
and the PDA 50. In one alternative, the user does not 
type in a device PIN for pairing, but a central data system 
uses unique identifiers such as MAC codes to pair de- 

15 vices. Thereafter, the PDA could also be used to capture 
biometric data related to a user. In an alternative, the 
user is authenticated using a customer number and 
password. Alternatively, the user could be authenticated 
using biometrics and the pen could be authenticated us- 

20 jng its unique Bluetooth 48 bit MAC address. 

[0060] In an alternative, selection boxes for profiles 
may be provided. For example, a user may have a pro- 
file for personal messages and a profile for business 
messages. The profile may include template text to add 

25 to the message and may include style commands to dic- 
tate how the data is processed. 

[0061] In another embodiment, a digital pen uses pa- 
per that is not preprinted as a facsimile cover page. The 
user writes a command on the paper that is interpreted 

30 by a facsimile processor. For example, the user writes 
">facsimileto: Bob" and ">message: see attached" and 
">attach: business plan" and ">signed: scriptsignature." 
Here, the facsimile processor is used to parse the com- 
mand to determine that a facsimile is being composed 

35 and is to be sent to Bob. The facsimile processor au- 
thenticates the user and searched a database of poten- 
tial recipients. If Bob unambiguously defines a single or 
group recipient, the facsimile processor expands the 
destination data into a form facsimile cover sheet. The 

40 facsimile processor then digitizes the message field into 
the cover sheet. The facsimile processor also parses the 
attach command. The facsimile processor uses infor- 
mation that may include the pen identifier, a user iden- 
tif ierto locate the attachment. The pen may authenticate 

45 the user. The facsimile processor may use the pen or 
user identity to determine the path and filename of the 
attachment and may use the pen or user identity of re- 
lated data to gain access to the appropriate file server. 
The facsimile server may determine that the sender is 

50 cleared to access the intended attachment. In an alter- 
native, the recipient must also be cleared to receive the 
attachment. 

[0062] The facsimile processor then recognizes the 
"signed" command that is also used to indicate that the 
55 facsimile should be sent. In an alternative, a button or 
other input such as voice recognition is used to indicate 
that the user is ready to send the facsimile. Here, the 
facsimile processorthen processes the attachment data 
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and determines the number of pages for the cover page. 
The facsimile is composed in the proper file format and 
sent to the recipient facsimile number using known fac- 
simile techniques. 

[0063] In an alternative, the composed facsimile mes- 
sage is sent to the recipient, but also logged into an out- 
going facsimile queue in a mailroom facility. Accordingly, 
the facsimile can then be processed in case of an error 
or other processing requirement. For example, the pen 
id or other user biometric data may be utilized to identify 
the sender and the sender's current contact information 
may be determined. The mailroom employee may then 
contact the sender if the message was not processed 
properly. 

[0064] In another embodiment, the digital pen in- 
cludes a pen stroke processor, a form and command 
processor and a communication processor including an 
analog cellular modem such that the digital pen includes 
the entire system for composing and sending a facsim- 
ile. In another alternative, the digital pen includes an at- 
tachments processor that uses the cellular modem to 
log into a file server, authenticate the user, identify the 
desired attachments, retrieve the desired attachments 
and compose and send the facsimile. The digital pen 
utilizes attachment data to fill in fields of the facsimile 
such as the cover sheet number of pages and the de- 
scription field for the facsimile attachments. 
[0065] In another alternative, the attachment may be 
printed on Anoto pattern as well. So for example, docu- 
ment number 0238820 version 5 may be printed on An- 
oto pattern and the user has a copy. The user may trace 
over or otherwise input the document number into the 
message processor and an annotate command is is- 
sued. Here, the system obtains document number 
0238820 version 5, processes the users annotations 
and attaches the annotated document as a facsimile at- 
tachment. 

[0066] In any of the described embodiments, error in- 
dications or messages may be communicated using 
LED indicators, a display such as an LCD display or au- 
dio indications such as beeps orsynthesized speech us- 
ing a speaker. Additionally, tactile feedback may be uti- 
lized to indicate an error condition or provide otherfeed- 
back such as an indication that a facsimile was success- 
fully sent. 

[0067] In any of the described embodiments, the user 
may wish to receive a receipt that can be traced back to 
the facsimile that the user wrote and sent. In the embod- 
iments described above, the composed facsimile mes- 
sage may be saved as a record of the facsimile and may 
be stored with a received receipt. Here, the user may 
want to correlate the original writing with the version 
sent. In this embodiment, the rasterized image is stored 
and used to identify the source writing. In another em- 
bodiment, the user writes a command for an identifica- 
tion value that is used to identify the source writing. In 
yet another alternative, a digital signature is developed 
for the original writing and it is sent with the facsimile 



message. In another alternative, the user may send a 
digital signature that is used to authenticate the mes- 
sage. Here, the biometric data from the pen strokes is 
used with the key of the user to provide non-repudiation 
5 of the facsimile message. 

[0068] In another alternative applicable to any of the 
embodiments, Wi-Fi enabled wireless systems are uti- 
lized and the external processor comprises a Wi-Fi ca- 
pable hand-held pocket PC such as the Toshiba e740 
10 Pocket PC. Furthermore, differing types of processors 
and logic systems may be supported. For example, 
JAVA based PALM OS devices may be utilized. The 
message logic, processing logic, security logic, user in- 
terface logic, communications logic and other logic 
15 could be provided in JAVA format or in a format compat- 
ible with individual platforms such as Windows CE and 
PALM OS. Similarly, other portable computing devices 
such as laptop computers and tablet computers and 
wireless capable computers could be utilized. Other 
20 platforms such as those using Symbian OS or OS-9 
based portable processors could be utilized. 
[0069] In another alternative applicable to any of the 
embodiments, authentication procedures utilize a token 
controller having a secure token key storage such as an 
25 iButton ® available from Dallas Semiconductor in which 
an attack, for example, a physical attack on the device, 
results in an erasure of the key information. Passwords 
may be used, such as a password to access the device. 
In an alternative, the password may include biometric 
30 data read from a user. Alternatively, other secret key or 
public key systems may be utilized. Many key exchange 
mechanisms could be utilized included a Key Encryption 
Key. Additionally, authentication and repudiation sys- 
tems such as a secure hash including SHA-1 could be 
35 utilized and encryption utilizing a private key for decryp- 
tion by public key for authentication. 
[0070] The present application describes illustrative 
embodiments of a system and method for composing 
messages using a pointing device and in one embodi- 
40 ment describes a digital pen system for composing and 
sending a facsimile. The embodiments are illustrative 
and not intended to present an exhaustive list of possi- 
ble configurations. Where alternative elements are de- 
scribed, they are understood to fully describe alternative 
45 embodiments without repeating common elements 
whether or not expressly stated to so relate. Similarly, 
alternatives described for elements used in more than 
one embodiment are understood to describe alternative 
embodiments for each of the described embodiments 
50 having that element. 

[0071] The described embodiments are illustrative 
and the above description may indicate to those skilled 
in the art additional ways in which the principles of this 
invention may be used without departing from the spirit 
55 of the invention. Accordingly, the scope of each of the 
claims is notto be limited by the particular embodiments 
described. 
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Claims 

1 . A method for composing a facsimile message com- 
prising: 

capturing strokes made by a user with a point- 
ing instrument that include indications of data 
including message data and command data; 
processing the strokes in order to determine a 
recipient designated by the strokes, and 
determining a template for the message using 
the strokes. 

2. The method of claim 1 wherein the pointing instru- 
ment is a digital pen and strokes are provided by a 
user writing on a media having a pattern. 

3. The method of claim 2 further comprising: 

capturing user authentication information relat- 
ed to the user. 

4. The method of claim 3 wherein: 

the user authentication information includes bi- 
ometric data. 

5. The method of claim 4 wherein: 

the biometric data includes pen stroke data in- 
cluding stroke pressure, stroke speed and pen 
attitude. 

6. The method of claim 2 wherein the command data 
includes an indication of a send facsimile com- 
mand. 

7. The method of claim 6 wherein the send facsimile 
command is indicated by the user writing a stroke 
in a segregated field of the media. 

8. The method of claim 2 wherein the template deter- 
mination utilizes a pattern. 

9. The method of claim 5 wherein the data includes an 
attachment identifier, further comprising: 

identifying the at least one attachment using 
the biometric data; 

authenticating the user using the user authen- 
tication information; and 
verifying user permission to access the attach- 
ment file. 

10. The method of claim 9, further comprising: 

determining determined message data using 
the attachment; and 



modifying the facsimile message using the de- 
termined message data. 

1 1 . A system for composing a facsimile comprising: 

5 

a processor; 

a storage device connected to the processor; 
the storage device storing a logic program; 
the processor operative with the logic program 
10 to perform: 

capturing strokes made by a user writing 
with a digital pen on a media having a pat- 
tern, the strokes including indications of 
15 data including message data and com- 

mand data; 

processing the strokes in order to deter- 
mine a recipient designated by the strokes, 
determining a template for the message 
20 using the strokes and the pattern; 

capturing user authentication information 
related to the user; and 

wherein the command data includes an indi- 
25 cation of a send facsimile command. 

12. The system of claim 11 wherein: 

the user authentication information includes bi- 
30 ometric data. 

13. The system of claim 12 wherein: 

the biometric data includes pen stroke data in- 
35 eluding stroke pressure, stroke speed and pen 

attitude. 

14. The system of claim 13 wherein the data includes 
an attachment identifier, further comprising the 

40 processor operative with the logic program to per- 
form: 

identifying the at least one attachment using 
the biometric data; 
45 authenticating the user using the user authen- 

tication information; and 
verifying user permission to access the attach- 
ment file. 

50 15. The system of claim 14, further comprising the proc- 
essor operative with the logic program to perform: 

determining determined message data using 
the attachment; and 
55 modifying the facsimile message using the de- 

termined message data. 

1 6. A system for sending a facsimile of a message com- 
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prising: 

a receiver to receive pen stroke data from a dig- 
ital pen including attachment data indicating at 
least one attachment; 

a processor to process pen stroke data; and 
a file server connected to the processor, where- 
in the processor uses pen stroke data to locate 
the at least one attachment and uses pen 
stroke data to verify permission to access the 
at least one attachments. 
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ABSTRACT: 

CHG DATE=20041005 STATUS=0>The present 
application describes systems and methods for 
composing and sending facsimile messages using a 
digital pointing instrument. In further 
configurations, a user utilizes a pen to indicate 
a reference to a document that is appended to the 
outgoing facsimile . In another further 
configuration, the user utilizes a form having pre- 
defined regions that are used to correlate a pen 
stroke with a desired action. 
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